Pre-Training Without Natural Images

Pre-training without Natural Images (IJCV / ACCV 2020 Best Paper Honorable Mention Award)

Hirokatsu Kataoka's Research

Rethinking Pre-training and Self-Training

A critical analysis of self-supervision, or what we can learn from a single image (Paper Explained)

These Natural Images Fool Neural Networks (And Maybe You Too)

Two Minute Papers

MedAI Session 19: Self-training/Weak Supervision + Untrained Neural Nets for MR Recon | Beliz Gunel

Improving Fractal Pre-training

ComputerVisionFoundation Videos

Deep image prior: simple code for image restoration with no training data needed

Contrastive Language-Image Pre-training (CLIP)

[LLM Training - Lecture 7] Build a Language Models using Transformers from Scratch - Foundations

When Vision Transformers Outperform ResNets without Pretraining | Paper Explained

Aleksa Gordić - The AI Epiphany

Understanding Deep Architectures and the Effect of Unsupervised Pre-training

Microsoft Research

Disentangled Pre-Training for Image Matting

ComputerVisionFoundation Videos

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion (ML Research Paper Explained)

ICML2020 | Outstanding Paper | Generative Pretraining From Pixels 🔥

DSAI by Dr. Osbert Tay

Image GPT: Generative Pretraining from Pixels (Paper Explained)

ImageGPT (Generative Pre-training from Pixels)

Self-Training improves Pre-Training for Natural Language Understanding

DreamTeacher: Pretraining Image Backbones with Deep Generative Models

DeepMind DetCon: Efficient Visual Pretraining with Contrastive Detection | Paper Explained

Aleksa Gordić - The AI Epiphany